STABILISATION OF LONG-PERIOD PERIODIC ORBITS USING 
TIME-DELAYED FEEDBACK CONTROL 
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Abstract. The Pyragas method of feedback control has attracted much interest as a method 
of stabiUsing unstable periodic orbits in a number of situations. We show that a time-delayed 
feedback control similar to the Pyragas method can be used to stabilise periodic orbits with arbitrarily 
large period, specifically those resulting from a resonant bifurcation of a heteroclinic cycle. Our 
analysis reduces the infinite-dimensional delay-equation governing the system with feedback to a 
three-dimensional map, by making certain assumptions about the form of the solutions. The stability 
of a fixed point in this map corresponds to the stability of the periodic orbit in the flow, and can be 
computed analytically. We compare the analytic results to a numerical example and find very good 
agreement. 
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1. Introduction. The stabilisation of unstable periodic orbits (UPOs) using 
feedback control has attracted the attention of many authors over a number of years. 
The time-delayed feedback method of Pyragas [T], has been of particular interest. 
Here, the feedback F is proportional to the difference between the current and a past 
state of the system. Specifically, F = K{x{t — r) — x{t)) where x{t) is some state 
vector, r is the period of the targeted UPO and K is a feedback gain matrix. Advan- 
tages of this method include the following. First, since the feedback vanishes on any 
orbit with period r, the targeted UPO is still a solution of the system with feedback. 
Control is therefore achieved in a non-invasive manner. Second, the only information 
required a priori is the period r of the target UPO, rather than a detailed knowledge 
of the profile of the orbit, or even any knowledge of the form of the original ODEs, 
which may be useful in experimental setups. The method has been implemented suc- 
cessfully in a variety of laboratory situations [ll[31lll[Sl[51[7l[5], as well as analytically 
and numerically in spatially extended pattern- forming systems [21 1101 [T2j ; more 
examples can be found in a recent review by Pyragas [13j . 

Until now, there has been little or no study on whether there are limitations to 
Pyragas feedback control as the period of the targeted orbit, and hence the delay 
time, becomes large. In this paper, we investigate the use of Pyragas feedback on 
unstable periodic orbits with arbitrarily large period. 

One mechanism for the generation of long-period periodic orbits is at bifurcations 
from homoclinic orbits or heteroclinic cycles. In this paper we focus on a subcritical 
bifurcation from a symmetric heteroclinic cycle, specifically the heteroclinic cycle of 
Guckenheimer and Holmes [21] . The bifurcation produces a branch of unstable long- 
period periodic orbits and we investigate using a time-delayed feedback control similar 
to the Pyragas feedback as a stabilisation mechanism. 

The addition of Pyragas feedback to the ODEs considered by Guckenheimer and 
Holmes results in an infinite-dimensional delay equation. In order to analyse trajec- 
tories near the periodic orbit of interest, we make a number of assumptions about 
the form of solutions to the delay-differential equation and reduce the flow to a three- 
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dimensional map. This method, after the assumptions have been made, is a modified 
version of the standard 'small box and Poincare map' analysis used by many authors 
to study the dynamics of trajectories close to heteroclinic cycles. This reduction of 
an infinite-dimensional delay equation to a finite dimensional map has not appeared 
before in the literature. Although our assumptions are not fully rigorously justified, 
we test the validity of our arguments by comparing our results with a numerical ex- 
ample. We find excellent agreement between the analytical and numerical results. A 
surprising result of the analysis for the particular example we use is that as the period 
of the orbit increases, the amplitude of the gain parameter required to stabilise the 
unstable orbits decreases. 

This paper is organised as follows. In section[2]we give a review of heteroclinic cy- 
cles and their bifurcations. We describe the Guckenheimer-Holmes heteroclinic cycle, 
and summarise the standard approach to analysing trajectories close to heteroclinic 
cycles. In section [3] we describe how we choose the feedback control terms which are 
added to the equations. We then perform the reduction of the equations described 
above, which gives us a method of computing the stability of the periodic orbits. 
Section [4] contains numerical examples and section [5] concludes. 

2. Review of heteroclinic cycles. A heteroclinic cycle is a topological circle 
of connecting orbits between at least two saddle-type equilibria. In generic (non- 
symmetric) dynamical systems, heteroclinic cycles are of high codimension and their 
existence for open sets of parameter values is unexpected. If a dynamical system 
contains flow-invariant subspaces, the connecting orbits can be contained within these 
subspaces, and then the heteroclinic cycle is robust to perturbations of the system 
that preserve the invariance of these subspaces. Flow invariant subspaces can arise 
due to symmetry, or due to other restrictions on the flow (such as extinctions in 
population dynamics models [14j). The review of Krupa [15| contains many examples 
of robust heteroclinic cycles. In this paper we consider robust heteroclinic cycles in 
symmetric systems. 

2.1. Preliminary definitions. Consider a continuous-time dynamical system 
defined by an ODE: 

x = f{x), xeR", (2.1) 

where / : M" R" is a A-equivariant vector field, that is, 

7/(x) = /(7x), V7eA, (2.2) 

and A C 0(n) is a finite Lie group. An equilibrium ^ G R" of (|2.ip satisfies /(^) = 0. 
We consider only hyperbolic equilibria, and assume that / is smoothly linearisable 
about each equilibrium. 

Definition 1. (t>j{t) is a heteroclinic connection between two equilibria and 
Ci+i (|2.ip if (j)j{t) is a solution of (|2.ip which is backward asymptotic to and 
forward asymptotic to . 

A heteroclinic cycle is an invariant set X C R" consisting of the union of a set 
of equilibria {^i, ...,^m} and orbits {4>i, ...,0,n}, where is a heteroclinic connection 
between S,j and and ^m+i = Ci- We require that m > 2. If m = 1, then 0i is a 

homoclinic orbit. A heteroclinic cycle is a homoelinic cycle if there exists 7 G A such 
that 7^j = Cj+i foi' all j ■ 

For x e R" we define the isotropy subgroup E^;, 



Sa; = {(J G A : (TX = x}. 



(2.3) 
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For E an isotropy subgroup of A, we define the fixed-point subspace 

Fix S = e R" : era; = x Vcr e E}. (2.4) 

Definition 2. A heteroclinic cycle X is robust if for each j, I < j < m, there 
exists a fixed-point subspace, Pj — Fix Sj where Sj C A and 

1. is a saddle and is a sink for the flow restricted to Pj, 

2. there is a heteroclinic connection from to contained in Pj. 

Robust heteroclinic cycles occur as codimension-zero phenomena in systems with 
symmetry. That is, they can exist for open sets of parameter values. Bifurcations of 
heteroclinic cycles therefore occur as codimension-one phenomena. We now consider 
the computation of the stability of heteroclinic cycles and the associated bifurcations. 

2.2. Resonant bifurcations. The stability of a heteroclinic cycle is usually 
computed by constructing Poincare maps on a Poincare section of the flow. The flow 
near the cycle is divided into two parts; the 'local' part, near the equilibria, where 
the flow can be well approximated by the linearised flow about the equilibria, and the 
'global' part of the flow, where the trajectory is away from the equilibria. The global 
part of the flow occurs on a much faster timescale than the local part and can be 
approximated by a linearisation of the flow around the heteroclinic connections. The 
construction of such Poincare maps is a standard procedure, details can be found in, 
for example [ini [12 • 

Heteroclinic cycles generically lose stability in two ways: resonant bifurcations and 
transverse bifurcations. Transverse bifurcations occur when one of the eigenvalues at 
an equilibrium passes through zero; the equilibrium undergoes a local bifurcation. 
We do not consider transverse bifurcations here, see [18] for details. Throughout this 
paper, when we refer to 'the eigenvalues at an equilibrium', we of course mean the 
eigenvalues of the Jacobian matrix of the flow linearised about that equilibrium. 

At a resonant bifurcation the eigenvalues at the equilibria are generically non- 
zero, but satisfy an algebraic condition that determines a global change in the stability 
properties of the cycle. Resonant bifurcations were first studied in the non-symmetric 
case by Chow et al. [19] in the context of a bifurcation from a homoclinic orbit. A 
more recent study |20j considers a codimension-two resonant bifurcation from a robust 
heteroclinic cycle with complex eigenvalues. 

Resonant bifurcations are generically accompanied by the birth or death of a 
long-period periodic orbit. If v is the bifurcation parameter controlling the reso- 
nant bifurcation (that is, v = at the bifurcation point), then the period T of the 
bifurcating periodic orbit generically scales as 



Resonant bifurcations can occur in a supercritical or subcritical manner. We consider 
the subcritical case, when the branching periodic orbits are unstable, and in the 
following show that Pyragas-type time-delayed feedback can stabilise the periodic 
orbits. Our analysis focuses on the Guckenheimer-Holmes cycle in R^. 

2.3. The Guckenheimer— Holmes cycle. The Guckenheimer-Holmes cycle [31] 
is a prototypical example of a robust heteroclinic cycle. We use this cycle as an exam- 
ple on which to base our analysis. First we review the original case with no feedback. 
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Fig. 2.1. The Guckenheimer-Holmes cycle inM.^. 



The equations considered by Guckenheimer and Holmes can be written: 

Xl = .Xl (1 — X — /i.X2 + '^■^3), 

±2 = a;2(l - X - /iXg + A.T^), (2.5) 
is = 2^3(1 - X - fixl + Xxl), 

where X — X]i=i M ^'^d A are real parameters. The equations are equivariant 

under the symmetry group A = Z3 k Zj, generated by a reflection ki and a rotation 
7: 

k{xi,X2,X3) ^ i-Xi,X2,X3), 
-f{xi,X2,X3) = ix3,Xi,X2). 

We label the equilibrium on the positive ^j. Here, and throughout the re- 

mainder of the paper, subscripts on equilibria, coordinates and similar objects should 
be taken mod 3. Each two-dimensional coordinate plane is a fixed point subspace. 
If /iA > 0, then the only equilibria in each coordinate plane are those lying on the 
coordinate axes. We consider the case /z, A > and then it can be shown that in 
the plane 0:3 = 0, ^1 is a saddle and ^2 is a sink. It can additionally be shown that 
in forward time trajectories are bounded away from infinity and therefore by the 
Poincare -Bendixson theorem there exists a heteroclinic connection from ^1 to ^2- 
Similarly, connections also exist from ^2 to ^3, and ^3 to <^i. These connections lie in 
two-dimensional fixed-point subspaces (the two-dimensional coordinate planes), so the 
cycle is robust. The resulting heteroclinic cycle is shown schematically in figure [2TT1 
Also note that 7^^ = ^+1, so the cycle is homoclinic. 

The stability of the cycle can be calculated using the methods described above. 
It is a standard procedure, but we outline the method here, as we use similar ideas 
later when considering the stability of periodic orbits in the system with added time- 
delayed feedback. Consider a trajectory which passes close to the equilibrium ^1. The 
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linearised flow near is: 

±1 = -2x1, (2.6) 

±2 = \X2, (2.7) 

X3 = -fJ.X3. (2.8) 

The xi direction is the 'radial' direction, and as shown in |22| . for heteroclinic cycles of 
this type, the radial direction does not affect the stability of the cycle. All trajectories 
move away from the origin, and also away from infinity, and in this case are attracted 
to an 'invariant sphere' [23] which contains the heteroclinic cycle. Therefore, for 
simplicity, we henceforth ignore this component. We define Poincare sections close to 

Hi'' = {(a;i,a;2,a;3)| 0<X2<h,X3 = h}, (2.9) 
H"""' ^{{xi,X2,X3)\ X2 = h,0<X3 <h}, (2.10) 

where < /i <C 1, and construct a Poincare return map on Consider a trajectory 
which passes through at time t = with 2:2(0) = x^- The trajectory will hit iJ™' 
at 

t = r,«(-i/A) iog(4//i) 

with 

We thus write down a local map (j)ioc ■ H™ 1-^ which describes the flow near the 

equilibria: 

x°3 = <^ioc(4) = /i'+^/^a^r^^ (2.11) 

The flow near the heteroclinic connection from iJf to a plane H)^ — iH™ near ^2 
is approximated by the global map 0fai- 

4=0f,,(a:°)=Axg + O(xf) (2.12) 

where x\ is the 0:3 coordinate of the trajectory when it next hits H2', and A is 
a positive constant. Note that the constant term in this expansion of (/)far is zero 
because the plane 2:3 = is invariant. We write (j) = 0far ° 4>\oc- Since ~ ^^^H™, 
the map ^~^4>{x\) is a return map on Write — j^^cf) and then the return map 
is 

(j){x) = Ax^ 

where S = ^/X. 

The map (f>{x) has fixed points at x = and at 2: = a:p = A-^/'^^~^\ The fixed point 
at 2; = corresponds to the heteroclinic cycle in the flow and is stable if 5 > 1. The 
heteroclinic cycle loses stability in a resonant bifurcation at (5 = 1. The second fixed 
point at X = Xp corresponds to a branch of periodic orbits, as long as Xp is small and 
positive. The symmetry 7 acts as a spatio-temporal symmetry on the periodic orbits. 
That is, if we write the periodic solution as a trajectory x* (t; fi, X), with minimal 
period T, then 

j-^x''{t)=x*{t-T/3). 
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The stability of the orbits can be determined by finding the stabihty of the fixed 
point Xp in the map <j). It is simple to see that if yl > 1, Xp is small and positive 
(and hence corresponds to a periodic orbit in the flow) when (5 > 1, so the resonant 
bifurcation is subcritical. We find that 

dx x—Xp 

and so Xp is unstable. Conversely, if ^ < 1, then Xp corresponds to a branch of stable 
periodic orbits if (5 < 1, and the bifurcation is supercritical. The period T of the orbit 
is approximately 

A — 

where r = — log(xp)/A and is the time spent by the trajectory each time it passes 
close to an equilibrium. We are ignoring the time spent away from the equilibria (that 
is, close to the heteroclinic connections in the invariant planes) since it is much less 
than T when we are close to the resonant bifurcation, that is, |1 — (5| ^ 1. 

In equations (j2.5p . the resonant heteroclinic bifurcation at /i = A is degenerate. 
That is, the branch of periodic orbits exists only at /i = A. This corresponds to 
the case A = 1 in the map (j). We add additional higher order terms to break this 



(2.13) 



The additional terms preserve the equilibria and the symmetries of the system, and 
also the invariant planes and the heteroclinic cycle. The heteroclinic cycle still loses 
stability in a resonant bifurcation at = A, but now a branch of periodic orbits is 
created in either /i > A or /i < A . The sign of a determines the branching direction 
and whether, in the map A is greater or less than 1. If a > 0, we see a branch 
of unstable periodic orbits in /i > A (and the resonant bifurcation is subcritical). If 
a < 0, we see a branch of stable periodic orbits in /i < A (and the bifurcation is 
supercritical). A complete study of the effect of fifth order terms on the dynamics 
near the GH cycle has not been performed. However, the above assertion can be seen 
by considering the effect of the new term on the Xj component when the trajectory 
is close to the Xj = plane but away from either coordinate axis. 

In the following, we consider the subcritical case, where the periodic orbits are 
unstable, and add non-invasive time-delayed feedback to stabilise the orbits near the 
heteroclinic cycle. 

3. Addition of feedback terms. 

3.1. Choice of coordinates. To ease analysis and improve the accuracy in the 
numerical computations in section [H we introduce new coordinates Yj = \og{x^). 
Along with a change in timescale, this transforms equations (|2.13p to 

= (1 - Y - /ie^^ + Ae^=* + ae^^+^^), 
Fa = (1 - Y - ^e^' + Ae^^ + ae^^+^0, (3-1) 
= (1 - Y - ^lc^^ + Ae^^ + ae^i+^^). 



we 


consider 
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= 2:1(1- 
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h \xl - 
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where Y = J2j=i^^^- Note that in these coordinates, the equihbria are at, e.g. 
Yi — 0, Y2 — — —oo. The invariant planes in the xj coordinates are transformed 
to Yj = —00. However, we are not interested in trajectories which he in the coordinate 
planes, only those which are close to them. 

3.2. Addition of feedback. Pyragas feedback is additive and has the form 
F — r(x(t — T) — x(T)) where F is a (real) gain matrix and T is the period of 
the targeted periodic orbit. Our choice of coordinates suggests the following slightly 
altered functional form for the feedback: 

/^YAt-T)-Y,(t) _ i\ 

i^ = r e^=(*-^)-^=(*)-l . (3.2) 
ye^3(t-T)-F3(t) _ij 

For trajectories close to the periodic orbit, Yj{t — T) — Yj{t) <^ 1 and so the feedback 
terms are approximately of Pyragas form. For this choice of feedback, the equilibria 
and the invariance of the coordinate planes (in the original Xj coordinates) are pre- 
served. However, we additionally choose to use the symmetries of the system to make 
a further change in the form of the feedback which simplifies the subsequent analysis. 
The feedback we use is: 




F = F e^i(*-")-^^W-l , (3.3) 

\e^2{t-r)-Ysit) _ij 

where r = T/S is one-third of the period of the orbit. Due to the spatiotcmporal 
symmetry of the periodic orbit under the action of 7, the feedback vanishes at the 
periodic orbit, and so the periodic orbit is still a solution of the system. However, 
this feedback does not preserve the equilibria or invariant planes (in the original Xj 
coordinates). 

We choose the matrix F in a similar manner to that in ^24j , as follows. We write 

F = EGE-^, 

where 

/O \ /I -1/2 V3/2 \ 

G= 60 cos /3 -60 sin/3 , £^=1 -1/2 -\/3/2 . (3.4) 
\0 60 sin/3 60 cos /3 / 1 / 

The matrix G has the form of the feedback matrix used by Fiedler et al. j25] in 
a two-dimensional example; stabilising periodic orbits emanating from a subcritical 
Hopf bifurcation. Recall that the orbit has two unstable directions, and one stable 
direction — the radial direction. The matrix E is chosen so the feedback is rotated 
to align with the unstable directions, and there is no feedback in the stable direction. 
The resulting equations with feedback are 



\ 








+ a 











' e 



Y3^-Yi 



I + M \ ey\ + a\ e^+y U- F e^^-^ - 1 , (3.5) 



where 




X-l -1 -A'-l and Yj ^Yj{t-T). 
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3.3. Stability analysis. We analyse the stability of the periodic orbits close 
to the heteroclinic cycle in a similar manner to the methods used without feedback. 
We assume we are close to the resonant bifurcation, that is, |1 — 5| ^ 1, so that the 
periodic orbit lies close to the heteroclinic cycle, and consider the flow close to the 
periodic orbit. The linearised equations close to the equilibrium are given by: 



where the Tjk are the components of the feedback gain matrix F. As before we 
neglect the Yi equation — since the feedback only acts in directions tangent to the 
plane containing the periodic orbit, we assume that when trajectories are close enough 
to the periodic orbit the dynamics in the radial direction are unaffected. That is, near 
^1, the Yi direction will be contracting and so not affect the stability of the orbit. In 
section 23] we show numerical results which support this assumption. 

Recall that the periodic orbits we are attempting to stabilise are spatiotemporally 
symmetric under the action of 7. We make use of this in the following. At each 
equilibrium, we define a contracting direction, and an expanding direction. At ^j, the 
contracting direction Yc is the Yj^i direction, and the expanding direction is the 
Yj+i direction. 

Unlike in the case without feedback, we cannot solve the linear equations explic- 
itly, and so we make the following approximations. Let Y*{t; fi, X) be the periodic 
orbit for the original system (in the logarithmic coordinates). Then Y* is still a so- 
lution of the system with feedback. Consider solving the delay differential equation 
for the system with feedback for a trajectory Y{t) which starts close to Y*. That is, 
for — T < t < 0, Y{t) is close to Y*{t). Then for Q < t < t, the feedback terms in the 
delay differential equation will be small, that is, the equations will only be a small 
perturbation from the original system. By continuity, the solution Y{t) for < i < r 
will also be close to Y*. 

Set i = as the trajectory intersects the plane i/j" {Yj-i = H, for H = \ogh, 
< /i ^ 1) on the ith time the trajectory passes close to an equilibrium, With no 
feedback, the local part of the trajectory can be written down exactly. The expanding 
and contracting components, Ye{t) and Yc{t) satisfy: 



for t S [0, Ti), where Ti is the length of time spent near the equilibrium (i.e. in the 
small box) and Y^ is the expanding coordinate of the trajectory as it intersects the 
plane Yc = H. 

For the system with feedback, we cannot explicitly solve the linearised equations. 
Given the argument above, we assume that we start sufficiently close to the periodic 
orbit that solutions are only a small perturbation away from those for the case with 
no feedback. That is, we write, for t € [0, Ti), 



Y2 = X + F22(Yl, - Y2) + F23(r2r " ^s), 
Y3 = -^^ + F32(Yi, - Y2) + T33{Y2r ~ Fs), 



(3.6) 
(3.7) 



Y,{t)=Yl^\t, 
Yc{t)=H-tit, 



(3.8) 
(3.9) 



Yc{t) = Y: + xt+m, 



(3.10) 
(3.11) 



where fi{t) and gi{t) are functions which satisfy 



Mt),g^{t) < 1, 



/,(0)=.g,(0)=0. 
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JJOUt 



t = T, 



Fig. 3.1. The figure shows a schematic of the local flow as the trajectory passes an equilibrium 
for the (i — l)th and ith time. The bold line indicates the periodic orbit. We set t = as the 



trajectory intersects H'J^ on the ith pass. 



The trajectory intersects HV^ at t = —Ti—i on the (i — l)th 



pass, which does not coincide with t = —r. Note that here we show the {i — l)th trajectory passing the 
same equilibrium as the ith trajectory — in actuality the (i — l)th pass is of the previous equilibrium, 
but because of the symmetries in the system this is equivalent, and schematically simpler to show in 
the figure. The diamonds (^) indicate the points of the trajectory at which times are indicated on 
the figure. The dashed lines indicate the surfaces H^^ and H°^^ . 



and if the trajectory is exactly the periodic orbit, fi{t),gi{t) = 0. We wih use this 
assumed form of the local flow together with equations (13. 6p and (|3.7p and the global 
flow as before to derive a new return map. This gives recurrence relations for Y^, and 
the functions fi{t) and gi{t). Figure [XT] shows a schematic of the local flow past an 
equilibrium ^j, in the original Xj coordinates. 

We again ignore the time the trajectory spends near the heteroclinic connections 
but away from the equilibria, so for t G [— T!i_i,0), the flow is given by 

Y,{t)=Y:-^+Xt + f,^i{t), (3.12) 
Y,{t)^H-fit + g,_i{t), (3.13) 

Using the symmetry 7, we can rewrite the linear equations p.6p and l|3.7p as 

Ye = X + r22(>;r -Y,)+ T^siYcr ~ Y,) , (3.14) 

Yc = -^i + r32{Yer - Y,) + T^^iYcr " Y,), (3.15) 

where the delayed terms are the corresponding coordinates near the previous equilib- 
rium, that is 



Fer =Y,{t^T)^ 1;(-t) +Xt + h^i{t) 

Y,r = Y,{t -t)= Y,{-t) -nt + g,^i{t) 



(3.16) 
(3.17) 



10 



CLAIRE M. POSTLETHWAITE 



The time of flight of the trajectory between the planes and Ti_i, will 

not be equal to the delay time r except when the trajectory is exactly on the periodic 
orbit (see figure [XT]) . In order to find the coordinates aX, t = — r, we assume the flow 
given by (|3.12p and (|3.13p is also valid for t G (— r, — Ti_i]. The coordinates of the 
trajectory a,i t = — r are therefore: 

Y,{~t) = + KT^-l -t)+ /.-i(T,_i - r), (3.18) 
Y,{-t) =H- ^i{T,^i - r) + 5,_i(r,_i - r). (3.19) 

Writing Ti — t + Ai, where A^/r <C 1 (since we are close to the periodic orbit) and 
expanding and gi^i about zero gives 

/,_i(A,) = /,_i(0) + A.-i/;_i(0) + • • • « A,_i/;_i(0), (3.20) 
5,„i(A,) - 5,_i(0) + A,_ig,:_i(0) + • • • « A,_i5:_i(0), (3.21) 

since f^{0) = 3^(0) = 0. Substituting into ([STS]) and (13719]) gives: 

YA-r) = yj-i + A,_i(A + fUm, (3.22) 
Fe(-T) =H + A,_i(-A^ + 5:-i(0)). (3.23) 

We also have that for t g [0, I^^), 

Y,{t) = X + m, Y,{t) = ~fi + g'M 

Substituting (PTU)) . (PTT|) . ([X^ and ([X^ into equations ([XTi)) and (jXTS)) we find: 

flit) = r22K"^ - y: + A,_i(A + /;_i(o)) + /,_i(i) - /.(t)]+ 

r23[A,_i(-/i + + 9^-iit) - g^it)], (3.24) 



9-it) = r32K-^ - + A.-i(A + /;_i(o)) + /._i(<) - /,(<)]+ 

r33[A,_i(-^ + gUm + g,^^{t) - g,{t)]. (3.25) 
These expressions are true for all t G [0, Ti), so we set t = to simplify and find: 

/;(o) =r22K"' - y: + A,_i(A + fum)] + r^siA^^.i-fi + gumi (3.26) 

ff-(O) -r32K-^ - y: + A,_i(A + /;_i(o))] + r33[A,_i(-^ + g[_M)], (3.27) 

that is, a recurrence relation for //(O) and 3^(0) if the A^ and Y^ are known. We write 
Xi = Yl - H,Xi= f[{0) + A and /i, = 5^(0) - n to further simphfy: 



A, =A + r22(X,_i -X, + A,_iA,_i) + r23A,_i/i,_i, (3.28) 

^JL^^-^l + r32(x,_i -x, + a,_iA,_i) + r33A,_i^,_i, (3.29) 

We next find an expression for A^ which we use to find a recurrence relation for 
the Xi. Recall that Yf,{Ti) = iJ, so from ((HTTU)) we have 

H ^Y,{Ti)=Y: + \T, + f,{Ti), (3.30) 
X,^-m- f,{T,). (3.31) 
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In order to be able to get tractable results in what follows, we need to invert the 
above equation for T^. Motivated by numerical results, which we give in section [4.11 
we make the following assumption: 

/.(ro«T,/;(o), 

that is, that fi is approximately a linear function of t. Using this gives us 
so 

A, =T,-T«-^ + ^ (3.32) 

where X* = -Ar = logA/(l - 5). 

We make a similar assumption on the g^, that is, gi{Ti) w Ti(/^(0), and then 
use (IXTTj) to find Yc{T,): 

Y° = Y,{T,) ^H+{-^i + g[{T))T, =H- ^X,, 

which is an expression for the local map 0ioc : — ^ Y° . We assume that the global 
map (/ifar is of the same form as the case without feedback (12.121) when we are close 
enough to the periodic orbit, and hence find a return map for the Xi: 

X^+^=\ogA-^X,. 

Ai 

Substituting equation p.32p into equations (|3.28p and (|3.29p results in a third 
order recurrence system: 

X, = log.4-^X,_i, 

A, = A + v,^ {^x* + ^^-i) + r23M.-i - f^) - log A, 
= + ( ^x* + ^x,A + r33M.-i ( ^ ^) log a. 



i-1 I V A Ai 



(3.33) 



Note that when V jk = 0, the recurrence relation reduces to that for the system with 
no feedback, as expected. This system of three recurrence relations has a fixed point 
at 

= A, /ii = — /i, Xi = X* 

which corresponds to the periodic orbit in the flow. The stability of the fixed point 
in the recurrence relation will correspond to the stability of the periodic orbit in the 
flow. 

The Jacobian matrix J of (|3.33p at this fixed point is: 

5 -bX -X 

J = I -<^(r22 - r23) l[r22 + <5(r22 - r23)] r22i' 

''5(r32 - r33) X[T32 + S{T32 " r33)] T32Xy 
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where X — X* /X. The characteristic equation of J is 

+ arn^ + bm + c ^ 0, (3.34) 

where 

a = XS{r23 - r22) - X(T22 + T32) - S, (3.35) 

^33 ^ r23r32 ) + X6{T33+T22), (3.36) 

C = -X^SiT22T33 - r23r32). (3.37) 

The fixed point will be unstable if (j3.34p has any solutions with |m| > 1, so curves 
with |m| = 1 define stability boundaries of the periodic orbit. Recall that T — EGE^^ 
and is a function of just two parameters, 60 and (3. We consider the stability of the 
periodic orbit as the parameters 5 and 60 are varied. 

3.4. Determination of stability boundaries. We split our investigation of 
the stability boundaries into three cases. We introduce the bifurcation parameter 
V = 5 — 1. Without feedback, the heteroclinic cycle is stable in > and the periodic 
orbits exist and are unstable va v > 0. We consider analytically the limits of the 
stability boundary curves as v, bo — > 0. The boundaries can actually be computed 
exactly (although the algebra is rather nasty) , since the eigenvalues are the roots of a 
cubic. We plot the boundaries for specific parameter values in figure [3T2l In section[4] 
we compute the stability of the periodic orbit in the original system p.Sp . numerically 
using the continuation package dde-biftool. 

Case 1: m — I. A stability boundary with rn = 1 corresponds to a steady state 
bifurcation of the periodic orbit. This occurs when l + a + 5 + c = 0, that is 

1-6 + l,5(r23 + r33) - X(T22 + T32) = 0. 

It can easily be computed that 

r23 + r33 = ^(cos;3-y3sin/3) (3.38) 



and 



3 



r22 + r32 = y(cos/3 + \/3sin/3) (3.39) 



In the limit z^, 69 0, using X ~ — , we find 



2 , 2 log A sin /3 
V ^pibo, pi = -j^ . (3.40) 



It is also simple to calculate that in the limit v ^ Q the eigenvalue which goes through 



m = 1 as this curve is crossed is greater than l\iv^ > pibo and less than liiv^ < pibg 



Case 2: rn = — 1. A stability boundary with rn = — 1 will correspond to a period- 
doubling bifurcation of the periodic orbit. These curves will have — 1+a — 6 + c = 0, 
that is, 



-1 - <5 + xs{r23 - 2r22 - r33) - x{r22 + ^32) - 2A25(r22r33 - r23r32) = 
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Again, we can compute the coefficients 




(3.41) 



— 2T22 — 



(7 cos (3 + sin (3) , 



(3.42) 



and in the same limit as above, we find 



1 



log A 
3A 



(4cos/3 + ^/3sin/3)— + 



(logA)2 bl 



^ = 
,2 



(3.43) 



3A2 ly- 



so there are two solutions bo = €±1^ for some c± function of A, A and /3. The direction 
of the bifurcation as these lines are crossed in this case depends on p. 

Case 3: m = e'^, 9 7^ mr. For m — e^^ , 9 ^ mr, it can easily be computed that 
we must have b + — ac = 1. The computations in this case are messier, so we omit 
them, and give the resulting curve in the limit 601 ^ 0, 



The direction of the bifurcation again will depend on /3. 

The curves (|3.40l) . (|3.43p and (|3.44[) describe the limiting cases of the stability 
boundaries of the periodic orbit as the point 1/ = &o = is approached. Since the 
characteristic polynomial (j3.34|) is cubic, it can be solved for any values of v and bo. 
In figure [3?2l we plot the solutions |m| — 1 of (j3.34|) for a specific set of parameter 
values. In this case only the curves corresponding to m = 1 and m = — 1 are stability 
boundaries. The lower boundary is the quadratic curve for m = 1 and the left hand 
boundary is a straight line corresponding to m = —1. The remaining curves with 
I TO I = 1 do not form stability boundaries in this case because the periodic orbit is 
already unstable in the regions in which they exist. 

We can see that for these parameter values, the periodic orbit is stable for a 
wide range of parameters, and specifically, can be stabilised arbitrarily close to the 
heteroclinic cycle, that is, for arbitrarily large period. That is, for any v > we can 
find a bo for which the periodic orbit is stable. In fact, for this particular case, we 
see that as 1/ gets smaller, in order for the orbit to be stable, we have to choose bo, 
the gain parameter, to be increasingly small. This seems a rather surprising result - 
that as the period of the targeted orbit increases, the amplitude of the gain parameter 
tends towards zero. 

3.5. Stability of the heteroclinic cycle. We note that the recurrence rela- 
tions (|3.33p have a second solution, A^ = X, iii — — /i, Xi — s- —00, which corresponds 
to the heteroclinic cycle. We can consider the stability of this solution by considering 
the solutions to ((334)) in the limit X -00. In this hmit, a ^ 0{X), b ^ 0{X'^) 
and c ~ 0{X^). The cubic equation (|3.34p therefore has one solution with m ~ 0(1) 
and two solutions with to ~ 0{X). Therefore this fixed point is always unstable in 
the recurrence relation, and so the heteroclinic cycle is always unstable in the flow. 

4. Numerical results. We use the Matlab package dde-biftool [26] to nu- 
merically analyse the stability of periodic orbits in the system (I3.5p . The delay time 
r was set equal to the period of the bifurcating periodic orbits (and so is a function 



&oy (iogA)4 /6oy 2(iogA)3 

ly J 3A4 \iy J 3A3 



(2cos/3-hV3sin/3) 



bl jlogA)^ 60 4 log A 
A2 jy A 



cos /? = 3 
(3.44) 
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Fig. 3.2. The figure shows the stability boundaries of the periodic orbit, that is, curves of 
solutions \m\ = 1 to equation 113.341 1. as fi and bg are varied. The lower boundary is a steady state 
bifurcation (m = 1) and the left hand boundary is a period- doubling bifurcation (m = —1). The orbit 
is stable in the wedge between these lines. Remaining parameters are X = 0.7, /3 = 7r/4, a = 0.01, 
so u = at fj. = 0.7 (left hand side of figure). 



of /i), and was calculated numerically from the system with no feedback. Parameters 
used were the same as those used to produce figure [3T2l 

Figure |4?T] shows a contour plot of the amplitude of the largest Floquet multiplier 
as the parameters bo and /x are varied. The periodic orbit is stable when all Floquet 
multipliers have amplitude less than 1, and this region is indicated by the shading in 
figure im Comparison with figure [3?2l showing the stability as calculated analytically, 
shows a very good agreement between the location of the stability boundaries. The 
shapes of the boundaries also agrees, that is, the left hand boundary is a straight line, 
whereas the lower boundary is part of a parabola. The nature of the bifurcations 
that occur as the boundaries are crossed also agrees with the analytical result. That 
is, the left hand boundary is a period-doubling bifurcation, with a critical Floquet 
multiplier equal to —1, and the lower boundary is a steady state bifurcation with a 
critical Floquet multiplier of +1. 

Forward integration of the equations ()3.5p also confirms the stability results. In 
figure 14.21 we show results from such an integration. We also show the derivative of 
the coordinates and the feedback terms. It can be seen that as the periodic orbit 
is approached, the derivative of the expanding coordinate tends to A (in this case, 
A = 0.7), and the feedback terms tend towards zero. 



4.1. Justification of assumptions. In section [3731 we make a number of as- 
sumptions regarding the form of solutions to the delay differential equations. Firstly, 
we assume that the 'radial' direction does not affect the stability of the periodic orbits, 
and so we neglect this coordinate in our construction of a Poincare map. Secondly, 
that trajectories starting near the periodic orbits will be only small perturbations 
from the form of solutions to the original equations without feedback. Thirdly, we 
make the assumption that f^{Ti) « rj/(0), and g^{Ti) « T,gl{0). 

Here, we address each assumption in turn and show that our numerical results 
support these assumptions. 



Figure 4.2(c) shows the feedback terms in a forward integration of equations (|3.5p 
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Fig. 4.1. The figure shows a contour plot of the magnitude of the largest Floquet multipliers of 
the periodic orbit, as the parameters bg and fi are varied. The orbit is stable when the largest Floquet 
multiplier has magnitude less than one, which is indicated by the shading. Remaining parameter 
values are X = 0.7, (3 = tt/A, a = 0.01, so v = at ^ = 0.7 (left hand side of figure). This figure 
was produced using dde-biftool. 





500 ^ 1000 1500 500 ^ 1000 1500 



(b) (c) 

Fig. 4.2. Figure (a) shows forward integration of equations 113. St . using Matlab routine dde23. 
Figure (b) shows the derivative of the curves shown in (a), it can be seen that the derivative of the 
expanding direction at each equilibria tends to 0.7 as the periodic orbit is approached. Figure (c) 
shows the feedback terms, Yj—i{t — T) — Yj{t), which clearly tends to zero as the orbit is approached. 
We can also see that the feedback term corresponding to the coordinates Yj — i{t — t) ~Yj{t) when we 
are near equilibria is much smaller than the other feedback terms. Parameters are fi = 0.7012, 
A = 0.7, feo = 0.0015, f3 = Tr/4, a = 0.01 
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Fig. 4.3. The figure shows forward integration of equations l|3.5| l. using Matlab routine dde23, 
for a parameter set in which the periodic orbit is unstable. Figure (a) shows a time series of the 
trajectory and figure (b) shows the feedback terms, Yj_i(t — r) — Yj{t). Parameters are fj, = 0.7012, 
A = 0.7, bo = 0.008, /3 = 7r/4, a = 0.01 



as the periodic orbit is approached. It can be seen here that the feedback terms 
corresponding to the radial direction are much smaller than the other feedback terms 
— on this scale they cannot be distinguished from zero. Hence the affect of the 
feedback on the radial direction is negligible and this assumption is justified. 

Regarding the second assumption, it can be clearly seen in figure 4.2(c) that the 
feedback terms decay to zero as the periodic orbit is approached. However, this is to 
be expected in the case that the periodic orbit is stable. In figure 14.31 we show the 
results of an integration in which the periodic orbit is unstable. It can be seen from 
the time series in 4.3(a) that the trajectories still remain approximately of the form 
of the periodic orbit even though the trajectory is moving away. Figure 4.3(b) shows 
the feedback terms, a measure of how close the trajectory is to the periodic orbit. 
Although they are increasing in magnitude, they do so in the same manner one would 
expect for an unstable periodic orbit in ordinary differential equations. That is, by 
starting trajectories close enough to the periodic orbit, the feedback magnitude can 
be bounded above for arbitrarily long time. 

The third assumption is that that fi{T,) « Tif[{<S), and g,{Ti) « Tig[{{)). Note 
that in the recurrence relations (j3.33p . the terms in //(O) only appear in the combina- 
tion A + //(0) (similarly with g[{Q) in the combination — /i + (7,-(0)). Therefore, we only 
need to show that the difference between //(O) and fi{Ti)/Ti is much smaller than 
A to justify our assumption (and similar for the gi). For the integration we perform 
for figure 4.2(a) we compute the values of //(O), Ti and fi{Ti) (and the corresponding 
values for gi) on each pass the trajectory makes past an equilibrium. We plot these 
values in figure 1131 It can be seen that the difference between //(0)/Ti and fi{Ti) 
(and between g[{Q)/Ti and gi{Ti)) is clearly very small, and is much less than A = 0.7 
(/I = 0.7012) for this example. 
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Fig. 4.4. The left figure shows the values of f^{0) (x 's) and fi{Ti)/Ti (open circles), and the 
right figure shows the values of g'^iO) (x 's) and gi{Ti)/Ti (open circles) on each pass the trajectory 
makes past an equilibrium (i) for the integration shown in figure\4.2(a)\ 



5. Discussion. We have shown that a time-delayed feedback control mechanism 
similar to that first introduced by Pyragas can be used to stabilise periodic orbits of 
arbitrarily large period, specifically those resulting from a resonant bifurcation from 
a heteroclinic cycle. Our analytical results are based on a analysis of the stabilisation 
of orbits near the Guckenheimer-Holmes cycle. These results are asymptotic, that 
is, they are correct in the limit of the periodic orbit being close to the heteroclinic 
cycle. However, in comparison with numerical results (which conversely, are much 
harder to obtain when the orbit is close to the cycle due to the long period of the 
orbit), the results actually agree for some large(ish) range of parameters away from 
the bifurcation point. 

It should also be possible to extend this analysis so that it applies to resonant 
bifurcations from higher dimensional heteroclinic cycles. However, care may need to 
be taken with the transverse eigenvalues. 

As the resonant bifurcation is approached, the period of the bifurcating periodic 
orbit grows like 1/v, where v is the bifurcation parameter. This is in contrast to the 
homoclinic bifurcation, in which case the bifurcating periodic orbit has a period which 
grows like — log i/. This difference in scaling between the growth rate of the periods 
of the orbits indicates that the results of adding similar time-delayed feedback near 
a subcritical homoclinic bifurcation may be quite different to the results given here. 
Work on this problem is ongoing. 
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